| min rank | avg. rank | sentence |
|---|---|---|
| 2318 | 9572.8333 | Selak memenangkan lotre bernilai jutaan dollar! |
| 1117 | 8781.3000 | Selanjutnya Typhoon River menawarkan kolam berbentuk sungai mengelilingi arena wahana. |
| 832 | 6063.4286 | Anak pertamanya bernama Alisha Puri Nareswari (3). |
| 621 | 3990.1429 | Hingga pluit panjang dibunyikan kedudukan imbang 1-1. |
| 587 | 1474.1667 | "Penghargaan ya penghargaan, hubungan ya hubungan. |
| 539 | 3529.3333 | Jika seseorang memprovokasi kamu, jangan bereaksi. |
| 536 | 4986.6250 | Sidang pengadilan militer dipimpin Letnan Kolonel Arman Nainggolan. |
| 406 | 2519.7143 | Caranya: memberi subsidi biaya angkut jarak jauh. |
| 399 | 5113.5000 | Tapi, jangan lupa memperhatikan tanggal kadaluarsanya. |
| 375 | 2430.0000 | Sedangkan surat suara disediakan 334 surat suara. |
| 370 | 3351.4000 | Para pejabat pembuat komitmen setingkat direktur selaku penanggung jawab pengadaan. |
| 340 | 3596.1111 | Katona, sang mantan istri, membalas komentar sang mantan suami. |
| 337 | 5182.2500 | Sepak bola - piala AFF 2010 - menjawab angan-angan publik. |
| 314 | 7746.8333 | Direktur Fesyen majalah InStyle Hal Rubenstein memuji pilihan warna berani Julianne Moore, gaun kuning panjang rancangan Dior. |
| 314 | 4105.7500 | Hal senada dikatakan Wakil Gubernur Jatim Saifullah Yusuf. |
| 301 | 878.6667 | "Kita sebenarnya tengah menghadapi krisis kepemimpinan. |
| 259 | 2447.7143 | Mereka pun sering terlihat berdua latihan maraton. |
| 253 | 6254.3333 | Biasanya khubz dipotong membentuk segitiga terlebih dahulu sebelum disajikan. |
| 241 | 1327.1000 | Grup A: Papua, Jawa Tengah, Gorontalo, Sumatera Selatan. |
| 221 | 4158.8750 | Hitungan sementara setiap jam melintas 200-300 kendaraan pemudik. |
| 217 | 2766.4286 | Perjalanan Belanda menuju puncak pun tak mulus. |
| 217 | 11135.3750 | Mereka tak henti bertakbir, memuji keagungan Pencipta semesta. |
| 215 | 2778.1250 | Terus berbenah bukan berarti Timnas Garuda tanpa kendala. |
| 203 | 3273.0000 | Banyak pemimpin partai maupun pemimpin pemerintahan, tetapi miskin ketokohan. |
| 193 | 5473.8889 | Hingga lagu terakhir "Muda", Agnes berhasil menghipnotis ratusan penggemarnya. |
| 191 | 5640.9000 | Pembangunan jalur ganda lintas selatan Jawa, yakni Cirebon-Kroya, Kroya-Kutoarjo, Solo-Madiun-Surabaya. |
| 191 | 8754.8421 | Beberapa saham pilihan, yakni Tiga Pilar Sejahtera Food (AISA), AKR Corporindo (AKRA), Total Bangun Persada (TOTL), Ciputra Development (CTRA). |
| 186 | 5571.6000 | Di akhir aksi, pengunjuk rasa membakar gambar Rafika Soraya Azhar. |
| 186 | 7638.8571 | Di "sekolah" Barcelona, Messi menimba kerendahan hati. |
| 182 | 4532.5000 | Sedangkan pupuk non-Urea mendapat subsidi Rp1.000 per kilogram. |
In contrast to subsection 4.5.2.1 we now search for sentences consisting of rare words only. The sentences are ordered by the rank of the most frequent word in a sentence. In the table, we see the corresponding sentences with a minimum length of 40 characters.
The sentences are forced not to contain any everyday word. As a consequence, we get either sentences of some very reduced structure or sentences in some foreign language. Hence, the data are useful for the evaluation of the preprocessing, especially language detection.
select min(w_id)-100 as m, avg(w_id)-100 as a, s.sentence from sentences s, inv_w i where s.s_id=i.s_id and length(sentence)>40 and i.w_id>100 group by s.s_id order by m desc limit 30;
Should we remove the sentences having its least frequent word above some threshold?
4.5.2.1 Maximum word rank in sentence
4.5.2.2 Average word rank in sentence
4.5.2.4 Sentences consisting of many low frequency words II
4.5.2.5 Sentences consisting of short words only I
4.5.2.6 Sentences consisting of short words only II
4.5.2.7 Sentences consisting of long words only I
4.5.2.8 Sentences consisting of long words only II